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ABSTRACT 
Concern over the reading and writing programs in 
Vancouver, British Columbia Schools culminated in the establishment 
in June 1974 of a Task Force on English. In response to the request 
from the Task Force for a survey of the writing ability of Grade 11 
students, a committee of English Department Heads assisted in 
developing an instrument and the testing procedures. The committee 
prepared instructions for teachers and a suggested rating scale. A 
covering letter was sent to the Principals of all secondary schools. 
The Composition Test was written by a ten percent, randomly selected 
. Sample of the students in Grade 11. The papers were marked by a team 
of five English teachers recruited from the ranks of substitutes and 
retired teachers. Various techniques were employed to test the 
reliability of marking including the marking of papers, selected at 
intervals, by all markers on the team. Blind duplicates of 28 papers 
were added at random and the marks of the originals and their copies 
were compared. The correlation was moderately high. (MV) 
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ABSTRACT 


This report explains the reasons for the survey and describes the 
development of the testing procedures. The report summarizes the results. 
While the median mark was "C," there were one-half as many more students 
with marks below "C" as those with marks above "C." For the non-English 
students the ratings clustered at the "D" - "E" levels; there were no 
marks above "C."" As the test was a locally-developed instrument without 
any previous standardization, there were no norms available. It was not 
possible to report the results in terms of grade equivalent scores or 
percentiles. The report includes specimens of student writing and a 
report from the marking team. It points out the strengths and weak- 
nesses of student performance and lists five recommendations for streng- 
thening in the instructional program of secondary schools in English 
composition. 


SURVEY OF ACHIEVEMENT IN COMPOSITION IN GRADE 11 
OF VANCOUVER SCHOOLS, FEBRUARY 18, 1975 


INTRODUCTION 


Concern over the reading and writing programs in Vancouver Schools 
culminated in the establishment in June, 1974 of a Task Force on English 
with the following terms of reference: 


"To determine whether the reading and writing program (K-12) 
meets the needs of the students in the context of today's 
society, and mone specifically to determine whether the current 
neading and writing program 46 adequate to prepare the student 
to achieve his social and economic goals, and to make recommenda- 
tions thereon." 


The Task Force calied for surveys of reading achievement at four levels 
(Grades 3, 5, 7 and 10) and surveys of composition in Grades 6 and 11. 


TESTING PROCEDURES 


In response to the request from the Task Force on English for a 
survey of the writing ability of Grade 11 students, a committee of English 
Department Heads assisted in developing an instrument and the testing 
procedures, (See Appendix A). The committee prepared instructions for 
teachers (Appendix B) and a suggested rating scale (Appendix C). A cover- 
ing letter was sent to the Principals of all secondary schools, (Appen- 
dix D). 


.he Composition Test was written by ten percent, randomly selected, 
of the students in Grade 11. (In a few schools, all students wrote the 
test - but only 10% of the papers, randomly selected, were submitted to 
the marking team). Teachers put notes on the test papers of students from 
non-English speaking homes who had been in Canada less than one year. 


The papers were marked by a team of five English teachers recruited 
from the ranks of substitutes and retired teachers. The team was super- 
vised by Mr. D. Martin, Chairman of the English Department Heads. A 
scoring guide (See Appendix E) was employed and checks were made sys- 
tematically to maintain consistency in marking. Various techniques were 
employed to test the reliability of marking including the marking of papers, 
selected at iutervals, by all markers on the team. Blind duplicates of 28 
papers were added at random and the marks of the originals and their copies 
were compared, (See Appendix F). The correlation was moderately high, r = 
+0.76. 


SUMMARY OF RESULTS 


The test instrument was developed locally and has not been standard- 
ized. Ic was not possible to report results in terms of percentiles or 
grade-equivalent scores. 


SUMMARY OF RESULTS (continued 


The marks assigned to the 481 papers in the sample are summarized in 
Appendix G. While the median mark was "C," there were one-half as many 
More students with marks below "C" as those with marks above "C." For 
the "non-English" students, there were no marks above "C" and almost 
three-quarters of them were given "D" or "E."" One specimen of writing 
at each level, "A," "C" and "E," is included in Appendix H to illustrate 
the range of quality in performance. 


The marking team submitted a report (See Appendix I) on the validity 
of the test, student performance and recommendations. The clear indication 
of the strengths and weaknesses of students’ abilities in composition has 
implications for all teachers of English. The team recommended that: 


- more time be devoted to the teaching of organizational skills such 
as outlining, proofreading and paragraphing. 


- a sequence of skills in language and composition be delineated and 
that units of time be scheduled for intensive instruction in compo- 
sition. 


- consideration be given to the division of English courses into Com- 
position and Literature and that composition classes be kept small 
to enable teachers to individualize instruction. 


- students who are learning English as a second language be required 
to take a more intensive program in English than is normally pos- 
sible. 


- markers included as an integral part of the secondary school team 
to establish contact with students and that the amount of marker 
time be substantially increased. 


Copies of the summary of results and the report of the marking team were sent 


to all secondary schools. 


APPENDIX A 


INSTRUCTIONS FOR STUDENTS FOR THE GRADE 11 COMPOSITION TEST 


The purpose of this test is to find out how well you can write a composition. 


1. Time 1 hours -- this should allow time for revision. 

2. You may work in pencii but the revised final copy must be written in ink. 
3. Work on ONE side of the foolscap. 

4. DOUBLE space your work. 

5. Dictionaries are NOT to be used. 

6. Put your name on EACH of the five sheets of foolscap. 

7. Write a short composition (approximately 300 words) on the topic suggested 


in the following passage: 


Man has created many machines or tools to help him. Select 
one modern invention which has had significant influence on 
our civilization and discuss whether its influence has been 
good or bad. Such inventions as the printing press, tele~ 


vision, automobile or telephone could be used. 


. 


16. 


APPENDIX B 


WRITING TEST FOR STUDENTS IN GRADE 11 


Februarv 18, 1975 
INSTRUCTIONS FOR TEACHERS WHO WILL ADMINISTER THE GRADE 11 COMPOSITION SURVEY 


Time Limit: One and one-half hours. 

No dictionaries. 

Give five sheets of foolscap to each student. 

Students work on one side of the paper. 

All five sheets must be handed in at the end of the exam. 

Time allotment must be strictly adhered to. 

Final copy should be in ink. 

The student should be sure that his Name, School Code Number and English 
Block are at the top of the final copy. With the final cony on top, the 
pages of each student's work should be stapled together. 

The English Department Head is asked to put a note on the top of the test 
paper of any student who comes from a non-English-speaking home and has 


been in Canada less than one year. (Both criteria must he met.) 


The completed test papers should be bundled and be SENT OR DELIVERED by 


FEBRUARY 21st, 1975 to: 


Mr. D. Martin, 

Chairman, English Department Heads 
c/o Teacher Centre 

123 East 6th Avenue 

VANCOUVER, B. C. V5T 1J6 


APPENDIX C 


RATING SCALE* (AS PROPOSED BY THE COMMITTEE OF DEPARTMENT HEADS. 


STUDENT'S NAME 


SCHOOL * GRADE 


A. CONTENT (What is said?) 50% 


Coherence 
Transition 


Conc Lusion 


BR. FORM (How it has heen said) 50” 


Title 


Spelling 


Punctuat ten 


Pianeta 


Percentage Achineed Pee Grade é 
(A,8,C0+,::,C-,D,E) 


*Note: This rating scale was subsequently modified. The team of markers 
used the scoring guide that appears in Appendix E. 
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APPENDIX D 


LETTER TO PRINCIPALS 


EVALUATION AND RESEARCH 
VANCOUVER SCHOOL BOARD 
VANCOUVER, B. C. 


rey 


&> February 7, 1975 
TO PRINCIPALS OF SECONDARY SCHOOLS: 
RE: WRITING TEST FOR STUDENTS IN GRADE 11 


A test in expository writing is to be written by a 10% sampling of students in Grade 11 
of all secondary schools in Vancouver. The purpose is to provide information to the 
Task Force on English about the writing abilities of students in Grade 11. 


Please select entirely at random a 10% sample of the Grade 11 population in your school. 
To do this, you may take every tenth name on a listing of students, use random numbers, 
or select students by lot. The English teachers should not be asked to make the selection. 


Please arrange for the selected students to write the test on Tuesday, February 18th. 
The time required is 1 hours. 


The instructions for the teacher (copies enclosed) should be given to them on Monday, 
February 17 but the test item and instructions for students (also enclosed) should not 
be distributed until the time of the test. 


Mr. Dave Martin, Chairman of the. English Department Heads, will assign through your 
English Department Head a code number to identify your school. 


The English Department Head is asked to put a note on the top of the paper of any 


student who comes from a non-English-speaking home and has been in Canada less than 
one year. (Both criteria must be met.) 


The English Department Head is asked to SEND OR DELIVER the completed test papers to: 
Mr. D. Martin 
Chairman, English Department Heads 
c/o Teacher Centre 
123 East 6th Avenue 
VANCOUVER, B. C. V5T 1J6 


The cooperation of the members of your staff is genuinely appreciated. 


_ Very truly yours, 


Qoru E. N. ELLIS 
Head, Evaluation and Research 


cc - English Department Heads 


sie 1 1 


i) 
ii) 


iii) 


ii) 


iii) 


i) 


ii) 


fii) 


APPENDIX E | 


SCORING GUIDE FOR MARKERS 


A - B PAPER 


Content 


Organization 
A definite and suitable plan clear throughout. 


Transitions are smooth and appropriate. 
Logical and effective paragraphs. 
Sentences are well constructed and varied. 
Words are used correctly and exactly. 


Mechanics 
Almost perfect mechanically. 
A maximum of 2 to 3 mistakes per page. 


C+ - C - C- PAPER 
Content 


Organization 
Plan evident but lacking in logic or suitabilitv to the subject. 


Simple and direct introduction and conclusion. 

Two or more cases of mechanic and/or awkward transitions. 
Prevailingly simple, clear paragraphs but without adequate 
development. 


Mechanics 

Average number of minor errors, 8 - 10 errors per page. 
Spelling maximum of 3. 

Punctuation maximum of 2. 

Never higher than 5 for spelling and punctuation. 


D - E PAPER 


Content 


Organization 
Plan not evident on careful first reading. 


Paper leaves no single impression. 

Lacking unity and coherence. 

The absence of ineffectual use of an introduction and conclusion. 
Two or more cases of a lack of continuity between paragraphs. 

Two or more pseudoparagraphs or ineffective paragraphs, fragments, 
or paragraphs containing irrelevant material. 


Mechanics 
Mechanics seriously interfere with an attempt to read the paper. 


12 


APPENDIX F 


COMPARISON OF MARKS ASSIGNED TO 28 SELECTED PAPERS AND TO THEIR 


BLIND DUPLICATES 


ORIGINAL COPIES 


PHOTOCOPIED PAPERS 


Contingency Coefficient r = +0.76 


APPENDIX G 


FREQUENCY OF RATINGS GIVEN TO COMPOSITIONS WRITTEN BY GRADE 11 STUDENTS 


Letter Grade "Non-English" Other Students All Students 
Students In The Sample 

A 28 ( 6.2%) 28 ( 5.8%) 

57 (12.6%) 57 (11.9%) 

C+ 68 (15.0%) 68 (14.1%) 

Cc 2 ( 6.9%) 91 (20.1%) 93 (19.3%) 

C- 6 (20.7%) 95 (21.0%) 101 (21.0%) 

10 (34.5%) 76 (16.8%) 86 (17.9%) 

11 (37.9%) 37 ( 8.2%) 48 (10.0%) 

Total 29 (100%) 452 (99.9%) 481 (100%) 


The bases of evaluation for assigning letter grades to paragraphs 
was content (25%), organization of material (50%) and mechanics of 
writing (25%). 
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APPENDIX H 


SPECIMEN OF WORK "A" 


Tn recent fines , many cvtlrodsial alguments have arisen concerning, the 
mate influence of She ‘hevigion , % mere commenly Frown as “hye becb4ube, 
| When lid inverted Ws oviey of Jobe ond wires Spree spilling, oof 
ives F people and animals, racentieted Sian billions cf Wile "electronic 
Hing" Ronling in the ky , dubs founded all and Let mcny behaving Ahe 
ese “in-the -corner a thine, F evil, something, thet stocks. the soul 
Pon 0 pelson', Somethire tha rocembled Rndovc's box. 
| For aubile, ot was the to, ff the wich a lorry often related with 


Serve {me Newever , aS Lene PAsed, Mase picduchen and the public demPacnd 


Homon’ for the “loetter thine in Me’ teck As tell and Seon in every 
| 


heose , \\veve scl 5 in the comer of the Wire, Yoon athe ol\ fois danthar 
square box 4 all too “xen develapins, into the Local geint of the house ‘ te - 
Ccal point of he I owily Ve. 


Shey st Suiely yA HRY Feligion becom bo \ckte reat and Ofors . 
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APPENDIX H, SPECIMEN OF WORK "A" (continued) 


The dildven, no loner satisfied wth ther" infarndile games’, 
(Laing Hicks as sons and ImpvoviSine, Wiems aa hoses), became move 
ictlodhed bo *4he Aube" sOnxiously deversing, sum Shoys as * Rouboy, 
ee heat el BATele Bill’, whe atl to-Wa 
Soations were being povayed 4 & bbledy Indion massacre , and Cagain 
Tile, of the Behe eee gelling bis men” 

Even the odulls ere net spaved Crom Ane enslaughit os they fee 
suecombed tothe paey AH the TV. ond become anchored Seinly. Ve 
longer did they need te deped on they necbws fer “Second hard inform ation, 
of Wicdge doom be the lord cyoems For a copay of the Daily Nass,t instead | 
ante inevitably, for that Lemilhay Knobs anthirgy ao the hypadic dat of 
hot on the scien expand ,and thee before bis alanced eyes danced the 
veel world awell its aloiy. The mgtlvcal sldb in an avmchaiy in Float of 


he tube, Q loves CONN th Oe \handd /o. Coy ih dhe other , 35 nat jus 6 


ponent of Someone’s vivid imagihatvon 
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APPENDIX H, SPECIMEN OF WORK "A"' (continued) 
The Serevisign became a cpa, Peele unnted bie, cree something, to 


fon c house around. Others wanted arly coeg the kid that the, con 
be wilh them wherever the, ge. A patable cigstal ball, Kepie, the 
| mee MW & ew constand slote of melanchdic deze, 

With the coming, of the cclow TV. a an haght # eax) wes 
reached. Meu, Prope cevlel sue mr Kwovite here in living, colour, 
dealing, across the sueen in on abstract mosic of covouR. 

Re one had ony need dey oct onymse, for ct Yer Gna hee wwe 
tlie fo the world, “Wwargh the TU. they ceutd tovel fo the C.- 
Rac tie Nay alia ie ety es 
suite. Cr almost __. - 

Ne community bbicke down, Eble, otemots wwe sail be inghodt he 
pbc on he proper wey ol the telension. Moun ft lad the cbili, 
\, op new pathos be those ehe might olhemse never oet the chance ; 


A ali morlced fhe decline of Many moral inchituhons > howi ne 


devly the vidlewt end desyp sig, neture of Man, 17 
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APPENDIX H, SPECIMEN OF WORK "A" (continued) 


Velev a ctbis “section cf * prime time” TV. we Qed sock 
= ei dhass ay, “Pil w Ih Genily", * Pokce Story", ? San bre od 
Gel Dan Regust” , and many othe shes bigsed on Prejudice ont 
sadness Le hs what all We Hecnalagy arel aclianemmmt of ou 
aah wold has brought os &7 Dd ve deelep ow mind only 

| 

be nd week ner virus of destvoyingt it ? 

| Whe ldeision is ever ayire, fo be vsect afeckively, drashe 
Meds will be needed in the. scheduline, cmd contest of the 
Seta da Wisin Se Vin ta ag bd Tite was 
heady diet of debvis aac oycle-que imaginetion. Che, of dre other, 
will ere acon commn come be a sudden cad viclot chame deed. 


Woraing, | Waotehinc jdlesteton can ‘be Wazarclous te your health --- 


L yor LS esi hb Sea ehy wee te or fre. 
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APPENDIX H - 14 


SPECIMEN OF WORK "'C" 


ay UL yrleiing compsitiors hail ey, | 
analeveispibia,: Qn mn Lopit. J will quire saunas of git. anole. 
haw rdlumen , ov Criilyalion, a0 J te thin), 
| Jove of Ve nach inflame Aw auderrnehile han. 
on ou) Ciriligationn wo Calo, Sht putt of purcharinp, 
ring, gemnak up: hee , Un Yul w vu hugh, For | 
srample , yao, can yal, or pak Quy where provry (6-6) GO- 3d 
Cemio puy gallon), anol ret cary hola oypraiirmatey 
M1} gotlend. Fron pul corn RL prohlem wy polluter, 
snhauct purr uv te av. Sha yuru car Adda jpn 
Yo Whew wv and Grnount. SY wniertsucdl dish of Cand . 


Contin, the amount oY ANhourat url rrwugat ; andl 


evclyatow Lumgu wit be plrur ley Ader apo 
fol arly Lo tors antl pblluliory Wak, hul 


wav) w ary Too dependant eyv a Mv. fiat per vv 
: 19 
tt ca anol duvet Awu eu tere wan't goool ertugh. Arar 
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APPENDIX H, SPECIMEN OF WORK "Cc" (continued) 
Lo Ange : ana (a) that pwhtrt woth Suorvd thea Adtunk to 


Ae ca wo mot goo0l envugh) CL eos) prays aheuth walt 
that won hlecka to the clore Awol met lyund on hin 


CAV 40 “mKY. 
Akthougs Cas Ao hak a paal Urpln th. a8) 


UrUilisalien , rey lo hart wome yotik vn ylnaes ti Jeu 
Marple, baveliog long dutanan vroulol miet Ae peels. 
without, aw. aulormepile. fr, vv a cart of aw ernungpeney 
oulormpbiles aid, ue ev perdi. many lara shel: be 
lsat Yo apttdl. lo mrudical vaults war mit poasble . Necwoeuvu, 
J Anak met, (fe) helo nut Rh tat Y avraw hadl AMBTL 
Ural ancl war poporcally healthy , thane wwouleln't be ao 
aman Preah errvrgentird . 

oD im spit sar cade Aalormohilig AMA he 

* olone Qiwraey vith), put. ymav could sdve feriracy , Aw 

hawk geetunt, ard te wal prone a lol ow pre. Ay 


vet olipenalin] ow that ear gp rus. 20 
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APPENDIX H 


SPECIMEN OF WORK "E"' 


Tre Jebphone. 

Human uinltigation ercatol th telphenc, uhih 
WMAND a wigmiftcant influmel on Lhe modu 
wold. The kiphene anabtel aptly, communication 
vanound tht glote, Uhith influenud humans 
JULI fom 
bebo the remaning ivekd, pryudic Luna fo 
umoeratancting ; welication , aeligin vand vmedical 
core unyuored, and gquur uxth ile of the telphm 
The ofc pn mookan cirilizalions smductol by 
Me tolls enarally, ad the imeluotrcel growth 
“OLLUNG fluxatoon wn pepiilitio and ummMige 
ation inca. The vmdio, another fom ¥& com- 
munication , Lenifitted from the tdiphone; He 


information ANA MUD Or wrtn faahion tou 


damproven und wor uplatd. At 40 due AAat 
21 
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APPENDIX H, SPECIMEN OF WORK "E" (continued) : 


) NY! 


without venicker, taamapiniation very things 
— ih not Lmprnrore. neanky as fast »but uwtthout 
thin uwenduful ununtion ; toot, Aheac thing 


\ 
| 


 UMighk run herr imprord vat all 
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APPENDIX I 


REPORT FROM THE MARKING TEAM 


I. The Validity of the Bxamination 


The marking team agreed that the examination topic was well chosen 
as it permitted the student considerable scope without giving particular 
individuals an unfair advantage. Pupils expressed many good ideas, evidenced 
an awareness of current problems, and wrote with concern and feeling. 


_ The examination was given to a ten percent randomly-selected sample 
of the grade eleven students in secondary schools. The circumstance of having 
some students write while others did not may have generated some resentment 
among a few of those who wrote. Markers also felt that students should have 
been instructed to write an essay of "at least 300 words” rather than 
“approximately 300 words". Some concern was expressed for the need to establish 
a wuitable atmosphere for writing before students began the examination. 


II. Areas Where Improvement is Needed 


A. Organization 
1. Fewer than ten percent of the students who wrote took time to develop 


an adequate outline. In most cases, students simply neatly recopied 
their rough draft. 


2. Many papers lacked logic and clarity. Paragraph development was 
generally inadequate. 


3. Concluding statements in most papers were either very mechanical or 
simply omitted entirely. 


4. Students need to be taught proofreading skills. 


B. Vocabulary and Spelling 


1. Students showed evidence of a good "passive" vocabulary, but failed to 
use words with accuracy and precision, frequently lapsing into cliche. 


2. Spelling was generally acceptable although some students confused 
homonyms such as "to", "too", "two", and "their", "there", "they're". 


C. Mechanics 


1. Perhaps the most obvious mechanical error was a lack of sentence sense. 
The papers contained many run-on sentences and fragments. 


~ 


2. Further work in coordination and subordination of ideas is necessary. 


qIr. 
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APPENDIX I: REPORT FROM THE MARKING TEAM (continued) 


Recommendations 


A. 


c. 


More time should be devoted to the teaching of organizational skills such 
as outlining, proofreading, and paragraphing. 


A definite sequence of skills in language and composition should be 
delineated, and units of time should be scheduled for intensive instruction 
in composition. 


The marking team recommends that consideration be given to the division of 
English courses into Composition and Literature, They felt strongly that 
class size in composition must be kept small to enable teachers to 
individualize instruction. 


A large percentage of the failing papers contained the type of error common 
with students who are learning English as a second language. The marking 
team recommends that such students be required to take a more intensive 
program in English than is possible in the normal classroom. 


To alleviate the present situation the marking team recommends a 
substantial increase in the amount of marker time available in secondary 
schools. Markers should be included as an integral part of the school team 
so that contact with students can be established. 
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